Handheld Device for Substitution from Vision to Audition

نویسندگان

  • Jean Rouat
  • Damien Lescal
  • Sean Wood
چکیده

Sensorial substitution has great potential in rehabilitation, education, games, and in the creation of music and art. Current technologies allow us to develop sensorial substitution and sonification systems that would not have been imaginable two decades ago. It is desirable to let a large audience use and test sonification systems to provide feedback and improve their design. Handheld devices like smartphones or tablets include network connectivity (WIFI and/or Cellular radio) that can be used to transmit anonymous information about the configuration and strategies adopted by users. It is now feasible to obtain feedback from any user of substitution and sonification technology and not only from a limited number of subjects in the laboratory. Testing in the field with a large number of users is now possible thanks to telecommunication networks and machine learning tools to analyze big data. This work presents a handheld implementation of a simple video sonification system designed to test the acceptability of vision to audition substitution systems and in the near future to provide feedback from users. A first beta version was publicly released in November 2013 as an iOS application for large scale testing. The extended abstract introduces the interface and the underlying technology.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Substitution as a Device of Grammatical Cohesion in English Contexts

The present study set out to investigate the effect of teaching substitution as a kind of grammatical cohesion on the true identification of confusing substitution elements with cohesive or non-cohesive roles in different contexts and also the production of modal, reporting and conditional contexts through clausal substitution acquaintance. To this end, the following procedures were taken. Firs...

متن کامل

Interference of Various Sources of Sensory Feedback on Transition of Relative Phase in Bimanual Coordination on Active and Inactive Woman With Multiple Sclerosis

Purpose: Comparing the effects of manipulating senses on relative phase transition bimanual coordination pattern of active and inactive women with Multiple Sclerosis (MS). Methods: The methodology of this study was repeated-measures design. Study participants comprised 10 active women and 10 inactive women with multiple sclerosis who voluntarily participated in this experiment. The participant...

متن کامل

Friction Sounds for Sensorial Substitution

This paper explores the use of a physics-based sound model of continuous contact for auditory display in interactive settings. An audio-visual interactive display is developed in which the sound model is controlled by the user’s gestures. The display is used to investigate to what extent audition can substitute for haptic feedback in conveying perception of inertial properties of a manipulated ...

متن کامل

Towards Transparent Handheld See-Through Devices

Authors maintain the copyright. Abstract See-through has been simulated for handheld devices to enable back-of-device interaction and for augmented reality applications. Researchers explored a wide range of applications for such devices and technologies to realize them. In this paper we revise previous work on simulated and real see-through handheld devices and their applications. Based on prev...

متن کامل

Cross-modal activation of visual cortex during depth perception using auditory substitution of vision.

Previous neuroimaging studies identified multimodal brain areas in the visual cortex that are specialized for processing specific information, such as visual-haptic object recognition. Here, we test whether visual brain areas are involved in depth perception when auditory substitution of vision is used. Nine sighted volunteers were trained blindfolded to use a prosthesis substituting vision wit...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014